System and method for providing live imagery associated with map locations

ABSTRACT

Near real-time imagery of a given location may be provided to user upon request. Most popularly viewed geographic locations are determined, and a 360 degree image capture device is positioned at one or more of the determined locations. The image capture device may continually provide image information, which is processed, for example, to remove personal information and filter spam. Such image information may then be provided to users upon request. The image capture device continually captures multiple views of the given location, and the requesting user can select which perspective to view.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 14/168,494, filed Jan. 30, 2014, the disclosure of which isincorporated herein by reference.

BACKGROUND

Upon request, map data for a given location and associated imagery maybe provided to a user. Such associated imagery is typically captured bya vehicle-mounted camera as the vehicle drives through the givenlocation, and then stored in a database. Because of the passage of timebetween image capture and providing the image to the user, the imagerymay depict information that is irrelevant or out of date. For example,the imagery may depict construction that is no longer ongoing, or abusiness that is no longer operational.

SUMMARY

Near real-time imagery of a given location may be provided to user uponrequest. Most popularly viewed geographic locations may be determined,and a 360 degree image capture device may be positioned at suchlocations. The image capture device may continually provide imageinformation, which is processed, for example, to remove personalinformation and filter spam. Such image information may then be providedto users upon request. Because the image capture device continuallycaptures multiple views of the given location, the requesting user canselect which perspective to view.

One aspect of the disclosure provides a computer-implemented method forproviding live imagery to users upon request. In this method one or morecomputing devices receive live images of a geographical location from atleast one image capture device, and process the received live images.Further, the one or more computing devices receive a request for mapdata corresponding to the geographical location, and provide therequested map data. The one or more computing devices further receive arequest for live imagery corresponding to the requested map data, anddetermine, based on the request for live imagery, a point of viewassociated with the requested live images. The one or more computingdevices provide processed live images corresponding to the determinedpoint of view and the requested map information. According to oneexample, the one or more computing devices further determinegeographical locations for which imagery is most often requested byusers, and the image capture device is positioned at the determinedgeographical location. The received images may include a continuous 360degree field of view around the image capture device. Processing thereceived live images may include detecting personal information, such ashuman faces and license plate numbers, and blurring the detectedpersonal information. Alternatively or additionally, processing thereceived images may include filtering spam data.

Another aspect of the disclosure provides a system comprising at leastone image capture device positioned at a geographical location, and oneor more processors in communication with the image capture device. Theone or processors are programmed to receive live images of ageographical location from at least one image capture device, processthe received live images, receive a request for map data correspondingto the geographical location, provide the requested map data, receive arequest for live imagery corresponding to the requested map data,determine, based on the request for live imagery, a point of viewassociated with the requested live images, and provide processed liveimages corresponding to the determined point of view and the requestedmap information.

Yet another aspect of the disclosure provides a non-transitorycomputer-readable medium storing information and instructions executableby a processor. When executed, the instructions perform a methodcomprising receiving live images of a geographical location from atleast one image capture device, processing the received live images,receiving a request for map data corresponding to the geographicallocation, and providing the requested map data. This method furtherincludes receiving a request for live imagery corresponding to therequested map data, determining, based on the request for live imagery,a point of view associated with the requested live images, and providingprocessed live images corresponding to the determined point of view andthe requested map information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional diagram of a system in accordance with aspects ofthe disclosure.

FIG. 2 is a pictorial diagram of the system of FIG. 1.

FIG. 3 is an example screen shot in accordance with aspects of thedisclosure.

FIG. 4 is another example screen shot in accordance with aspects of thedisclosure.

FIG. 5 is another example screen shot in accordance with aspects of thedisclosure.

FIG. 6 is a flow diagram of an example method in accordance with aspectsof the disclosure.

DETAILED DESCRIPTION

Overview

Upon request by a user, live imagery of a given location may be providedto the user over the Internet in association with map data for the givenlocation. For example, an image capture device may be positioned at thegiven location and may continually provide imagery to one or morecomputing devices. The one or more computing devices process the imageryto, for example, remove personal information (e.g., faces and/or licenseplate numbers) and filter spam. A user may request map data for thegiven location, and may also request live imagery of the given location.In response to the request, the one or more processors provide theprocessed live images associated with the requested map data.

The image capture device may be, for example, a 360 degree video camera.In this regard, the image capture device may continually capture a 360degree field of view around the image capture device. According to oneexample, in requesting the live imagery, the user may specify aviewpoint for the imagery. For example, the user may submit directionalinformation with the request for imagery, and in response receive asegment of the captured imagery.

Positioning of the image capture device may be determined based onpopularity. For example, the one or more computing devices may determinefor which geographical locations the most requests for map data orimagery are received. Image capture devices may be positioned at thedetermined locations. Preferably, the image capture devices arepositioned so as to prevent tampering.

The processing performed on the captured images may be automated. Forexample, the one or more processors may automatically detect personalinformation, such as faces, license plates, or other information. Inresponse to detecting such information, the one or more processors bluror otherwise obscure the information such that it is not provided to auser in response to a request. Moreover, the one or more processors maydetect and filter spam. For example, it may be determined that imagesfrom an unauthorized image capture device or other unauthorized contentare being received in addition to or in place of approved images.Accordingly, the unauthorized content and images may be filtered.

Example System

FIGS. 1 and 2 include an example system 100 in which the featuresdescribed above may be implemented. It should not be considered aslimiting the scope of the disclosure or usefulness of the featuresdescribed herein. In this example, system 100 can include one or morecomputing devices 110, which may be connected to further computingdevices 160 and 170 over a network 150.

Computing devices 110 can contain one or more processors 120, memory 130and other components typically present in general purpose computingdevices. The memory 130 can store information accessible by the one ormore processors 120, including instructions 132 that can be executed bythe one or more processors 120.

Memory 130 can also include data 134 that can be retrieved, manipulatedor stored by the processor. The memory can be of any non-transitory typecapable of storing information accessible by the processor, such as ahard-drive, memory card, ROM, RAM, DVD, CD-ROM, write-capable, andread-only memories.

The instructions 132 can be any set of instructions to be executeddirectly, such as machine code, or indirectly, such as scripts, by theone or more processors. In that regard, the terms “instructions,”“application,” “steps” and “programs” can be used interchangeablyherein. The instructions can be stored in object code format for directprocessing by a processor, or in any other computing device languageincluding scripts or collections of independent source code modules thatare interpreted on demand or compiled in advance. The instructions 132can be executed to perform operations such as detecting personalinformation in received images, modifying the received images to blur orobscure such information, or the like. The instructions 132 may also beexecuted to perform spam detection and filtering. Functions, methods androutines of the instructions are explained in more detail below.

Data 134 can be retrieved, stored or modified by the one or moreprocessors 120 in accordance with the instructions 132. For instance,although the subject matter described herein is not limited by anyparticular data structure, the data can be stored in computer registers,in a relational database as a table having many different fields andrecords, or XML documents. The data can also be formatted in anycomputing device-readable format such as, but not limited to, binaryvalues, ASCII or Unicode. Moreover, the data can comprise anyinformation sufficient to identify the relevant information, such asnumbers, descriptive text, proprietary codes, pointers, references todata stored in other memories such as at other network locations, orinformation that is used by a function to calculate the relevant data.According to one example, the data may include map information forgeographical locations. Moreover, the data 134 may include informationrelated to image capture device 190, such as an identifier and locationinformation.

The one or more processors 120 can be any conventional processors, suchas a commercially available CPU. Alternatively, the processors can bededicated components such as an application specific integrated circuit(“ASIC”) or other hardware-based processor. One or more of computingdevices 110 may include specialized hardware components to performspecific computing processes, such as decoding video, matching videoframes with images, distorting videos, encoding distorted videos, etc.faster or more efficiently.

Although FIG. 1 functionally illustrates the processor, memory, andother elements of computing device 110 as being within the same block,the processor, computer, computing device, or memory can actuallycomprise multiple processors, computers, computing devices, or memoriesthat may or may not be stored within the same physical housing. Forinstance, the memory can be a hard drive or other storage media locatedin housings different from that of the computing devices 110. As anotherexample, various methods described below as involving a single component(e.g., processor 120) may involve a plurality of components (e.g.,multiple computing devices distributed over a network of computingdevices, computers, “racks,” etc. as part of a parallel or distributedimplementation). Further, the various functions performed by theembodiments may be executed by different computing devices at differenttimes as load is shifted from among computing devices. Similarly,various methods described below as involving different components (e.g.,device 110 and device 160) may involve a single component (e.g., ratherthan device 160 performing a determination described below, device 160may send the relevant data to device 110 for processing and receive theresults of the determination for further processing or display).Accordingly, references to a processor, computer, computing device, ormemory will be understood to include references to a collection ofprocessors, computers, computing devices, or memories that may or maynot operate in parallel. For example, the computing devices 110 mayinclude server computing devices operating as a load-balanced serverfarm, distributed system, etc. Yet further, although some functionsdescribed below are indicated as taking place on a single computingdevice having a single processor, various aspects of the subject matterdescribed herein can be implemented by a plurality of computing devices,for example, communicating information over network 150.

Each of the computing devices 110 can be at different nodes of thenetwork 150 and capable of directly and indirectly communicating withother nodes of network 150. Although only a few computing devices aredepicted in FIGS. 1-2, it should be appreciated that a typical systemcan include a large number of connected computing devices, with eachdifferent computing device being at a different node of the network 150.The network 150 and intervening nodes described herein can beinterconnected using various protocols and systems, such that thenetwork can be part of the Internet, World Wide Web, specific intranets,wide area networks, or local networks. The network can utilize standardcommunications protocols, such as Ethernet, WiFi and HTTP, protocolsthat are proprietary to one or more companies, and various combinationsof the foregoing. Although certain advantages are obtained wheninformation is transmitted or received as noted above, other aspects ofthe subject matter described herein are not limited to any particularmanner of transmission of information.

As an example, each of the computing devices 110 may include web serverscapable of communicating with a storage system 140, image capture device190, and computing devices 160, 170 via the network 150. For example,one or more of server computing devices 110 may receive live imageryfrom the image capture device 190 through the network 150, and mayfurther transmit processed imagery to the client devices 160, 170 usingthe network 150. As another example, one or more of server computingdevices 110 may use network 150 to transmit and present information to auser, such as user 191, 192, on a display, such as displays 165 ofcomputing devices 160, 170. In this regard, computing devices 160, 170may be considered client computing devices and may perform all or someof the features described herein.

Each of the client computing devices 160, 170 may be configuredsimilarly to the server computing devices 110, with one or moreprocessors 162 and memory, including data 163 and instructions 164 asdescribed above. Each client computing device 160, 170 may be a personalcomputing device intended for use by a user 191, 192 and have all of thecomponents normally used in connection with a personal computing devicesuch as a central processing unit (CPU), memory (e.g., RAM and internalhard drives) storing data and instructions, a display 165 (e.g., amonitor having a screen, a touch-screen, a projector, a television, orother device that is operable to display information), and user inputdevice 166 (e.g., a mouse, keyboard, touch-screen or microphone). Theclient computing device may also include a camera 167 for recordingvideo streams, speakers, a network interface device, and all of thecomponents used for connecting these elements to one another.

Although the client computing devices 160, 170 may each comprise afull-sized personal computing device, they may alternatively comprisemobile computing devices capable of wirelessly exchanging data with aserver over a network such as the Internet. By way of example only,client computing device 160 may be a mobile phone or a device such as awireless-enabled PDA, a tablet PC, or a netbook that is capable ofobtaining information via the Internet. In another example, clientcomputing device 170 may be a head-mounted computing system. As anexample the user may input information using a small keyboard, a keypad,microphone, using visual signals with a camera, or a touch screen.

As with memory 114, storage system 140 can be of any type ofcomputerized storage capable of storing information accessible by theserver computing devices 110, such as a hard-drive, memory card, ROM,RAM, DVD, CD-ROM, write-capable, and read-only memories. In addition,storage system 140 may include a distributed storage system where datais stored on a plurality of different storage devices which may bephysically located at the same or different geographic locations.Storage system 140 may be connected to the computing devices via thenetwork 150 as shown in FIG. 1 and/or may be directly connected to anyof the computing devices 110, 160, 170.

Storage system 140 may store images and associated information such asimage identifiers, orientation, location of the camera that captured theimage, intrinsic camera settings (such as focal length, zoom, etc.),depth information, as well as references to other, target images.Storage system 140 may also include information used for processing liveimagery received by the one or more servers 110 from the image capturedevice 190. For example, the storage system 140 may include dataassociated with previously identified spam, such that the data can beused to identify and filter spam from the live imagery.

The image capture device 190 may be a camera, such as a video camera, orany other device capable of capturing images of a particulargeographical location. According to one example, the image capturedevice 190 is a 360 degree video camera, which continually captures a360 degree field of view around itself. According to another example,multiple image capture devices may be deployed at one geographicallocation. The image capture device may be positioned at the geographicallocation in such a way as to prevent or mitigate potential tamperingwith it. According to some examples, the image capture device 190 ispositioned at geographical locations selected based on popularity. Forexample, the one or more computing devices 110 may determinegeographical locations for which map data and/or imagery are most oftenrequested by users, and image capture devices 190 may be placed at thosedetermined locations.

Example Methods

Using the system described above, live imagery of geographical locationsis provided to users upon request. The live imagery may be received atthe one or more server computing devices from the image capture deviceand processed, for example, to remove personal information, such asfaces and license plates numbers, and filter spam. The live imagery caninclude 360 degree panoramas. Users can request map data and imagery forthe geographical location, and receive the processed live imagery inresponse. The users may also specify a particular point of view, and acorresponding portion of the 360 degree panorama is provided.

FIG. 3 illustrates an example screenshot 300 providing map informationfor a given geographical location corresponding to an address entered insearch field 310. The map information includes, for example, a roadgraph320. A place marker 322 may indicate a position on the roadgraph 320corresponding to the entered location. View option buttons 325, 335,345, 355 are also provided, wherein each button provides an option for adifferent representation of the geographical location. For example, themap button 325 may correspond to a roadgraph, such as the roadgraph 320.The street button 335 may correspond to still imagery of thegeographical location taken from a perspective of someone standing atstreet level. The satellite button 345 may correspond to satelliteimagery, showing a view of the geographical location from space. Thelive button 355 may correspond to live imagery captured by an imagecapture device dedicated to obtaining imagery of the specifiedgeographical location, such as the image capture device 190 (FIGS. 1-2).

FIG. 4 illustrates an example screenshot 400 illustrating an example ofthe live imagery associated with the specified geographical location andprovided to the user. For example, the geographical locationcorresponding to address 415 is depicted by roadgraph 420, on which aposition viewpoint indicator 462 and a directional viewpoint indicator464 is placed. Live imagery appearing in viewing field 450 correspondsto the address 415 and the roadgraph 420. The live images may be viewedby the user, for example, by selecting live view button 455 among optionbuttons 425, 435, 455. The images provided in viewing field 450 mayinclude a portion of images actually captured and provided to the servercomputing devices. For example, while the image capture devicepositioned at the geographical location may obtain images with acontinuous 360 degree field of view, only a segment of such field ofview may be shown in viewing field 450. That segment corresponds to aposition and direction of indicators 462, 464. According to otherexamples, the full images captured, such as the entire 360 degree fieldof view panorama, may be provided to the user in one or more viewingfields.

The position indicator 462 and directional indicator 464 may bemanipulated by the user, for example, to receive images of a differentviewpoint. FIG. 5 illustrates another example screenshot providing liveimagery corresponding to a different view of the same geographicallocation as in FIG. 4. In particular, while position indicator 562remains in the same position as position indicator 462 (FIG. 4),directional indicator 564 has been manipulated to point to a differentdirection, such as towards North. Accordingly, the live imagery providedin viewing field 550 shows a different area of the geographicallocation. According to the example where a 360 degree image capturedevice positioned at the location is providing the images, the imagesshown in the viewing field 550 may be another portion of the 360 degreepanorama. In this regard, the user may repeatedly request differentportions of the 360 degree frame. According to some examples, becausethe imagery provided in the viewing field 550 is live, objects in theimagery may appear to be moving. Moreover, the imagery may becontinually updated as new images are received.

The imagery provided in FIGS. 4-5 is processed by one or more computingdevices prior to being provided to users. For example, personalinformation and spam may be removed. As an example of removing personalinformation, an automatic face detection and blurring operation may beperformed on the imagery. Similarly, license plate numbers and otherpersonal information may be detected and blurred or otherwise obscured.As an example of spam filtering, spam such as people putting their facesclose up to the camera or people holding up signs with slogans may bepresent in the received images. Such spam may be detected, for example,using face detection or text detection algorithms. Detected spam may beblurred in the images or obscured by a black box or other object. Thus,while the imagery is described as being “live,” it should be understoodthat the imagery may actually be subject to a small delay, such as a fewsecond to a few minutes. According to another example, images includingdetected spam may not be sent to users. For example, last availableclean live imagery from the given geographical location, which does notinclude spam, can be provided. In some instances, such last availableclean images can be provided with a timestamp or note indicating thedelay.

According to one example, crowd-sourcing techniques may be used as partof the spam detection and filtering process. For example, users maysubmit reports identifying spam included in the live imagery for a givenlocation. In response to receiving a predetermined number of reports forthe given location, the last available clean images may be provided tousers in place of the more recent images that include spam.

FIG. 6 provides a flow diagram illustrating an example method 600. Thefollowing operations do not have to be performed in the precise orderdescribed below. Rather, various steps can be handled in a differentorder or simultaneously. Steps can also be omitted unless otherwisestated.

In block 610, one or more computing devices receive live images of ageographical location from at least one image capture device. The atleast one image capture device may be, for example, a 360 camera thatcontinually captures images in directions all around a vertical axis.Such image capture devices may be positioned at selected geographicallocations throughout the world. According to one example, thegeographical locations may be selected by determining the locations forwhich imagery and/or map data is most often requested by users.

In block 620, the received live images may be processed, for example, toremove personal information and filter spam. For example, the one ormore server computing devices may automatically detect objects such asfaces, license plates, etc. Once detected, the received imagery may bemodified to obscure those objects. For example, the detected objects maybe blurred, covered, or the like. Spam may affect the received images invarious ways. For example, it may be determined that images from anunauthorized image capture device or other unauthorized content arebeing received in addition to or in place of approved images. Such spammay be automatically filtered using any of a number of techniques.

In block 630, a request for map data corresponding to the geographicallocation is received by the one or more computing devices. For example,a user may enter an address, point of interest, or other relevantinformation in a search field of an interface. In response, therequested map data is provided to the user (block 640). For example, anaddress and/or a roadgraph or other depiction of the geographicallocation may be provided.

In block 650, a request for live imagery corresponding to the requestedmap data is received. For example, the user may select an option to viewlive imagery from among several other types of views. Further, the usermay identify in the request a specific area of the geographical locationto view. For example, the user may identify position and/or directionalinformation associated with the requested imagery. Such information maybe indicated by the user by manipulating icons, entering text, providingspeech commands, navigating through a depiction of the location, or thelike.

In block 660, a point of view associated with the requested live imageis determined based on the request for live imagery. For example, theone or more computing devices may determine from information receivedfrom the user which specific area of the geographical location the userwould like to see live.

In block 670, processed live images corresponding to the determinedpoint of view and the requested map information are provided to theuser. For example, a portion of the captured 360 degree panorama may beto the user, wherein the provided portion corresponds to the positionand direction specified in the user's request. According to anotherexample, the full 360 degree panorama may be provided in one or moreviewing fields. Because the imagery is continually captured, the imageryprovided to the user may be continually updated.

The above described features may be advantageous in that they provideusers with the most up to date information regarding a specifiedlocation. For example, users can become informed about weather, traffic,construction, events, or other details associated with a geographiclocation. Such information may be more reliable than other sources ofthe same information, because the users can view it first hand,regardless of their current location. Using such information, users canmake decisions about visiting the geographic location, or just becomebetter educated about it.

As these and other variations and combinations of the features discussedabove can be utilized without departing from the subject matter definedby the claims, the foregoing description of the embodiments should betaken by way of illustration rather than by way of limitation of thesubject matter defined by the claims. As an example, the precedingoperations do not have to be performed in the precise order describedabove. Rather, various steps can be handled in a different order orsimultaneously. Steps can also be omitted unless otherwise stated. Inaddition, the provision of the examples described herein, as well asclauses phrased as “such as,” “including” and the like, should not beinterpreted as limiting the subject matter of the claims to the specificexamples; rather, the examples are intended to illustrate only one ofmany possible embodiments. Further, the same reference numbers indifferent drawings can identify the same or similar elements.

The invention claimed is:
 1. A computer-implemented method comprising:receiving, by one or more servers, live images of one or more remotegeographical locations from at least one image capture device positionedat each of the one or more geographical locations, wherein the one ormore geographical locations are remote from the one or more servers, thereceived live images including a 360 degree field of view around the atleast one image capture device; receiving, by the one or more servers, arequest from a user device for live images corresponding to a given oneof the one or more remote geographical locations; providing, by the oneor more servers, live images to the user device for display, the liveimages corresponding to the given remote geographical location;continually receiving, by the one or more servers, input regarding apoint of view selected for the requested live images, the point of viewcorresponding to a portion of the 360 degree field of view around the atleast one image capture device; and continually updating, by the one ormore servers, the provided live images corresponding to the given remotegeographical location based on received input regarding the selectedpoint of view.
 2. The method of claim 1, further comprising processing,by the one or more computing devices, the received live images whereinthe processing includes automatically detecting and obscuring personalinformation from the received live images.
 3. The method of claim 2,wherein obscuring the detected personal information comprises blurringthe detected personal information.
 4. The method of claim 3, wherein thepersonal information includes at least one of human faces and licenseplate numbers.
 5. The method of claim 2, wherein processing the receivedlive images comprises detecting and filtering spam data, the filteringincluding at least one of removing unauthorized images or obscuringunauthorized content from the received live images.
 6. The method ofclaim 1, wherein: receiving the request for live images includesreceiving at least one of position and direction information associatedwith the requested images; and determining the point of view associatedwith the requested live images is based on the at least one of positionand direction information.
 7. The method of claim 6, wherein the atleast one of position and direction information is received throughmanipulation of icons, entered text, or speech commands.
 8. The methodof claim 6, wherein the at least one of position and directioninformation is received through a user's navigation through a depictionof the location.
 9. A system comprising: at least one image capturedevice positioned at a geographical location; one or more processors incommunication with the image capture device, wherein the geographicallocation is remote from the one or more processors, the one orprocessors programmed to: receive live images of the remote geographicallocation from the at least one image capture device, the received liveimages including a 360 degree field of view around the at least oneimage capture device; receive a request from a user device for liveimages corresponding to the remote geographical location; provide liveimages corresponding to remote geographical location to the user devicefor display; continually receiving input from the user device regardinga point of view selected for the requested live images, the point ofview corresponding to a portion of the 360 degree field of view aroundthe at least one image capture device; and continually updating theprovided live images corresponding to the remote geographical locationbased on the received input regarding the selected point of view. 10.The system of claim 9, wherein the one or more processors are furtherprogrammed to process the received live images, wherein the processingincludes automatically detecting and obscuring personal information fromthe received live images.
 11. The system of claim 10, wherein obscuringthe detected personal information comprises blurring the detectedpersonal information.
 12. The system of claim 11, wherein the personalinformation includes at least one of human faces and license platenumbers.
 13. The system of claim 10, wherein processing the receivedlive images comprises detecting and filtering spam data, the filteringincluding at least one of removing unauthorized images or obscuringunauthorized content from the received live images.
 14. The system ofclaim 9, wherein: receiving the request for live images includesreceiving at least one of position and direction information associatedwith the requested images; and determining the point of view associatedwith the requested live images is based on the at least one of positionand direction information.
 15. The system of claim 14, wherein the atleast one of position and direction information is received throughmanipulation of icons, entered text, or speech commands.
 16. The systemof claim 14, wherein the at least one of position and directioninformation is received through a user's navigation through a depictionof the location.
 17. A non-transitory computer-readable medium storinginformation and instructions executable by a processor for performing amethod of providing live images, the method comprising: receiving, atthe processor, live images of a remote geographical location from atleast one image capture device, the received live images including a 360degree field of view around the at least one image capture device;receiving a request for live images from a user device, the live imagescorresponding to the remote geographical location; providing live imagescorresponding to the remote geographical location to the user device fordisplay; continually determining a point of view selected by the userdevice for the requested live images, the point of view corresponding toa portion of the 360 degree field of view around the at least one imagecapture device; and continually updating the provided live imagescorresponding to the remote geographical location based on the selectedpoint of view.
 18. The non-transitory computer-readable medium of claim17, wherein: receiving the request for live images includes receiving atleast one of position and direction information associated with therequested images; and determining the point of view associated with therequested live images is based on the at least one of position anddirection information.
 19. The non-transitory computer-readable mediumof claim 18, wherein the at least one of position and directioninformation is received through manipulation of icons, entered text, orspeech commands.
 20. The non-transitory computer-readable medium ofclaim 18, wherein the at least one of position and direction informationis received through a user's navigation through a depiction of thelocation.